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(54) POSTURE INFORMATION INPUTTINGSTORINGREPRODUCING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To make an occupant of a simulator able to 
selectively experience a sense of movement which the occupant has experienced 
by extracting the sense of movement (posture information) experienced by the 
occupant himself of the simulatorstoring the sense of movementand selectively 
reading out it. 

SOLUTION: In the posture information inputtingstoringreproducing device 100a 
user 16 boarding on a seat truck 14 for occupant inputs the posture of a simulator 
body 10 taken in from a displayed image using a simulator movement information 
input device 6. The inputted posture information is stored in a simulator movement 
information storing device 4 corresponding to the images. And the user 16 
selectively reads outthrough an operation panel 7one of the images stored in an 
image storing device 1 to display it and furtherposture information corresponding 
to the image is selectively read out to activate the simulator body 10. 



CLAIMS 



[Claim(s)] 

[Claim 1]An attitude information input store-and-forward-of-switching-signal 
device comprising: 

A displaying means which displays a visual image observed from an object which 
moves on a user. 

An input means which inputs a motion of said object in which a user is sensed 
according to said image displayed by said displaying means. 

The 1st memory measure that synchronizes a motion of said said inputted object 
with said image displayed by said displaying meansand memorizes it. 



A control means which controls a motion of said simulator based on a motion of 
said object memorized by said 1st memory measure synchronizing with said image 
displayed as a simulator corresponding to said object which moves a user gets into 
[ simulator ] by said displaying means. 

[Claim 2]The 2nd memory measure that said 1st memory measure carries out 
multiple-times memory of the motion of said object inputted using said input 
meansand memorizes said two or more imageslt has further a selecting means 
which chooses one motion of said object corresponding to said selected image 
which chooses one and is memorized by said 1st memory measure in said image 
memorized by said 2nd memory measureThe attitude information input store-and- 
forward-of-switching-signal device according to claim 1 with which said displaying 
means displays said image with said selected selecting meansand said control 
means operates said simulator based on a motion of said object with said selected 
selecting means. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]Especially this invention relates to the attitude information 
input store-and-forward-of-switching-signal device which can input and 
accumulate the move feeling sensed from an imageand can be reproduced further 
in an attitude information input store-and-forward-of-switching-signal device. 
[0002] 

[Description of the Prior Art]There is a pseudo experience type vehicle 
amusement device which is in the vehicle simulator and amusement park for 
operation training conventionally as what experiences move feeling. 
[0003]These devices are a screen which displays the image observed from the 
object which movesand a false vehicle a user gets into [ vehicle ]and are provided 
with the simulator which has a rolling mechanism about a yawa pitchthe low X- 
axisa Y-axisand the Z-axisand a parallel advancing mechanism of order and the 
upper and lower sides. 

[0004]In order to operate a simulatorwhile acquiring video information with the 
camera for photography beforehand installed in the vehicle which movesattitude 
information is acquired with the position and the attitude sensor attached to 
vehicles (or camera for photography installed in the vehicle) at the time of 
photography. 

[0005]An image is displayed on the passenger of a simulator. The simulator itself 
makes rotational movement of the circumference of 3 axesand translation motion 
perform based on the attitude information in sync with an image. 
[0006]As a resultby movement of the simulator set by the image displayed 
aheadthe passenger of a simulator is hallucinated as if the simulator was actually 



moving in real space. 

[0007]In : "composition of the move feeling using a motion platform" by Iwata and 
othersVirtual Reality Society of Japan convention collected papersVo.land pp 
239-242 (Octoberl 996). An example of the method which operates a simulator 
using the attitude information acquired by the sensor attached to the camera is 
shown. 
[0008] 

[Problem(s) to be Solved by the Invention]Howeverin order to operate a 
simulatorit is necessary to use a position and an attitude sensor and to acquire 
attitude information by the conventional methodin this way. 
[0009]That isin the conventional devicethe simulator does not operate only with 
an image. Thereforethe general-purpose simulator that it could respond to various 
vehicles only with an image was not able to be realized. 

[0010]In order to solve this problemextracting the attitude information of the 
camera for photography and operating a simulator using the extracted attitude 
information by performing image processing to the photoed imageis also 
consideredbut it is not enough by existence of the vibrational noise in an image 
etc. 

[001 1]The attitude information acquired simultaneously with an image is not based 
on a passengerbut is immobilization. Thereforethe motion is uniform even if who 
gets into [ a simulator ]. 

[0012]Thereforethis invention is providing the attitude information input store- 
and-forward-ol^switching-signal device which can experience easily the move 
feeling sensed when it actually rides on a vehicle only using an image not using the 
position and attitude sensor made in order to solve the problem shown above. 
[0013]Other purposes of this invention are to provide the attitude information 
input store-and-forward-of-switching-signal device which can experience 
vicariously move ****** which not only self but other passengers received. 
[0014] 

[Means for Solving the Problem]An attitude information input store-and-forward- 
of-switching-signal device concerning claim 1 is provided with the following. 
A displaying means which displays a visual image observed from an object which 
moves on a user. 

An input means which inputs a motion of an object in which a user is sensed 
according to an image displayed by displaying means. 

The 1 st memory measure that synchronizes a motion of an inputted object with an 
image displayed by displaying meansand memorizes it. 

A control means which controls a motion of a simulator based on a motion of an 
object memorized by the 1st memory measure synchronizing with an image 
displayed as a simulator corresponding to an object which moves a user gets into 
[ simulator ] by displaying means. 

[0015]An attitude information input store-and-forward-of-switching-signal device 
concerning claim 2Are an attitude information input store-and-forward-of- 



switching-signal device concerning claim land the 1st memory measureThe 2nd 
memory measure that carries out multiple-times memory of the motion of an 
object inputted using an input meansand memorizes two or more imagesHave 
further a selecting means which chooses one motion of an object corresponding to 
a selected image which chooses one and is memorized by the 1st memory 
measure in said image memorized by the 2nd memory measureand a displaying 
meansDisplaying an image with a selected selecting meansa control means 
operates a simulator based on a motion of an object with a selected selecting 
means. 
[0016] 

[Embodiment of the Invention][Embodiment 1] The attitude information input 
store-and-forward-of-switching-signal device in the embodiment of the invention 
1 is memorizing and reading the extracted attitude informationand makes it 
possible to experience vicariously selectively the move feeling which the user 
sensed while it extracts move feeling (attitude information) from the user itself 
who looks at an image. 

[0017]The process in which the attitude information as which the user itself is 
sensed is extracted and memorized from an image is called an attitude information 
input accumulative processand the process in which move feeling is experienced 
using the memorized attitude information is called an attitude information output 
process. Hereafterthe attitude information input store-and-forward-of-switching- 
signal device in the embodiment of the invention 1 is explained. 
[0018] Drawing 1 is a figure showing the entire configuration of the attitude 
information input store-and-forward-of^switching-signal device 100 in the 
embodiment of the invention 1. 

[0019]The attitude information input store-and-forward-of-switching-signal 
device 100 is provided with the image storage device 1the image output unit 2the 
screen 3 for video outputsthe simulator body 10and the seat stand 14 for 
passengers. 

[0020]The image storage device 1 accumulates the video information about the 
on-the-spot photo image which actually moved and photoed the vehicleor the 
image generated by computer graphics technology (memory). 
[0021 ]The image output unit 2 receives in an input the video information 
memorized by the image storage device 1. Based on control of the image output 
unit 2the image according to the video information read from the image storage 
device 1 is displayed on the screen 3 for video outputs. 

[0022]The simulator body 10 imitates a relative motion of a moving face. The 
simulator body 10 has a rotational movement function about the circumference of 
the translation motion function of the upper and lower sides and order and the X- 
axisa Y-axisand 3 axes of the Z-axis. 

[0023]The seat stand 14 for passengers is arranged on the simulator body 10. The 
user 16 sits on the seat stand 14 for passengers. The user 16 who sits on the 
seat stand 14 for passengers experiences move feeling according to change of the 
posture of the simulator body 10inputting attitude information from the simulator 



motion information input device 6 later mentioned while looking at the image 
displayed on the screen 3 for video outputsor looking at an image. 
[0024]The attitude information input store-and-forward-o^switching-signal 
device 100 is further provided with the navigational panel 7the controller 8the 
simulator motion information input device 6the simulator motion information 
storing device 4and the simulator body motion control device 5. 
[0025]The user 1 6 chooses whether alter operation (attitude information input 
accumulative process) of attitude information is performedor the move feeling 
using the memorized attitude information is experienced (attitude information 
output process) using the navigational panel 7. 

[0026]When an attitude information input accumulative process is chosenthe 
identifier about each of two or more images accumulated in the image storage 
device 1 is displayed on the navigational panel 7. Herean identifier is for 
distinguishing each image and the title of an image is mentioned as an example. 
The user 16 chooses any 1 image from two or more images via the navigational 
panel 7. 

[0027]When an attitude information output process is chosenthe identifier of two 
or more attitude information accumulated in the simulator motion information 
storing device 4 mentioned later and the image accumulated in the image storage 
device 1 is displayed on the navigational panel 7. The user 16 chooses any 1 image 
and any 1 corresponding attitude information. The information displayed on the 
navigational panel 7 is transmitted via the controller 8 mentioned later. 
[0028]The simulator motion information input device 6 is a device for the user 16 
to input the posture of the seat stand 14 for passengers sensed from the image 
displayed on the screen 3 for video outputs. The simulator motion information 
input device 6 will be in the state where it can input in an attitude information 
input accumulative process. As the simulator motion information input device 6the 
metering device which measures the center of gravity of a joy stick type input 
device and the users 16 body and change of inclination is used. 
[0029]The simulator motion information storing device 4 is accumulated 
corresponding to the image which has the attitude information inputted from the 
simulator motion information input device 6 displayed (memory). The simulator 
motion information storing device 4 will be in the state which can be written in in 
an attitude information input accumulative processand will be in the state which 
can be read in an attitude information output process. 

[0030] Drawing 2 is a figure showing an example of the memory content of the 
simulator motion information storing device 4 shown in drawing 1 . As shown in 
drawing 2 the user who inputted input timethe attitude information (angle of 
rotation of the circumference of the X-axisa Y-axisand the Z-axisetc.) in each 
timeand attitude information into the simulator motion information storing device 4 
as an examptethe corresponding identifier of an imageetc. are memorized. In 
drawing 2 the attitude information which the user A inputted about the image of 
the identifier M1the attitude information which the user A similarly inputted about 
the image of the identifier M2and the attitude information which the user B (it 



differs from the user A) inputted about the image of the identifier M2 are 
memorized as an example. 

[0031]In an attitude information output processthe user 16Via the navigational 
panel 7the image (the image of the identifier M1 in drawing 2 or the image of the 
identifier M2) of 1 is chosenand further corresponding attitude information (when 
the image of the identifier M2 is chosen in drawing 2t hey are the user's A attitude 
information or the user's B attitude information) is chosen. The selected attitude 
information is outputted to the simulator body motion control device 5. 
[0032]With reference to drawing 1t he simulator body motion control device 5 
controls the posture of the simulator body 10 based on the attitude information 
outputted from the simulator motion information storing device 4. 
[0033]The controller 8 sends the information (for examplethe contents of the 
video information accumulated in the image storage device 1 and the contents of 
the attitude information accumulated in the simulator motion information storing 
device 4) needed to the navigational panel 7 according to directions of the 
navigational panel 7. The controller 8 controls operation of the image storage 
device 1the simulator motion information storing device 4and the simulator motion 
information input device 6 according to directions of the navigational panel 7. It is 
judged whether the controller 8 has change in the attitude information inputted 
one by one from the simulator motion information input device 6or the attitude 
information read from the simulator motion information storing device 4 one by 
one. 

[0034]Nextthe attitude information input accumulative process in the attitude 
information input store-and-forward-of-switching-signal device 100 is explained 
using drawing 3 which is a flow chart. 

[0035] Drawing 3 is a flow chart for explaining the attitude information input 
accumulative process in the attitude information input store-and-forward-of- 
switching-signal device 100 in the embodiment of the invention 1. In drawing 3t he 
flow of the processing after the user 16 chooses an image is indicated. Let only 
change of rotation of the circumference of 3 axes of the simulator body 10 be a 
processing object as an example of attitude information in drawing 3 . 
[0036]In this casethe video information chosen from the image storage device 1 is 
read by the controller 8and the image corresponding to the screen 3 for video 
outputs is displayed. It will be in the state which can input the attitude information 
from the simulator motion information input device 6. It will be in the state which 
can write in the simulator motion information storing device 4. 
[0037]The user 16 inputs attitude information from the simulator motion 
information input device 6 according to the image displayed on the screen 3 for 
video outputs (Step S1). 

[0038]It is judged whether the controller 8 has the information which changed from 
the time of the last input about attitude information (Step S2). 
[0039]When there is no change in attitude informationit moves to step S9 and the 
attitude information at the time of the last input is made to memorize as attitude 
information at the time of this input to the simulator motion information storing 



device 4. Or it makes it memorize to have been changeless. 
[0040]When attitude information has changeas shownfor example in drawing 3 it 
moves to Step S3S5or S7and the rotation information of the circumference of 3 
axes is extracted. 

[0041] For examplewhen there is rotation of the circumference of the X-axisthe 
rotary data of the circumference of the X-axis is acquired (step S4). 
[0042]When there is rotation of the circumference of a Y-axisthe rotary data of 
the circumference of a Y-axis is acquired (Step S6). 

[0043]When there is rotation of the circumference of the Z-axisthe rotary data of 
the circumference of the Z-axis is acquired (Step S8). 

[0044]Attitude information is memorized by the simulator motion information 
storing device 4 based on the rotary data acquired at step S4Step S6or Step S8 
(step S9). 

[0045]It returns to Step S1 after the end of step S9and the input of the attitude 
information from the user 1 6 is performed. The information (user name) about the 
identifier and user of an image is memorized with attitude information. 
[0046]In an attitude information input accumulative processsince the simulator 
motion information storing device 4 is not way readthe attitude control of the 
simulator body 10 by the simulator body motion control device 5 is not performed. 
[0047]Nextthe attitude information output process in the attitude information input 
store-and-forward-of-switching-signal device 100 is explained using drawing 4 
which is a flow chart. 

[0048] Drawing 4 is a flow chart for explaining the attitude information output 
process in the attitude information input store-and-forward-of-switching-signal 
device 100 in the embodiment of the invention 1. In drawing 4t he flow of the 
processing after the user 16 chooses an image and attitude information is 
indicated. Let only change of rotation of the circumference of 3 axes of the 
simulator body 10 be a processing object as an example of attitude information in 
drawing 4 . 

[0049]In this casethe video information chosen from the image storage device 1 is 
read by the controller 8and the image corresponding to the screen 3 for video 
outputs is displayed. Simultaneouslythe simulator motion information storing 
device 4 will be in way read. 

[0050]The attitude information chosen from the simulator motion information 
storing device 4 by the controller 8 synchronizing with the image displayed is read 
(Step S11). 

[0051]It is judged whether the controller 8 has the attitude information (change 
information) which changed in response to this attitude information (Step S12). 
[0052]When there is no change informationit is changeless to the posture 
condition of the simulator body 10and read-out of the following attitude 
information is performed further (it returns to Step S1 1). When there is no change 
informationattitude information is not transmitted to the simulator body motion 
control device 5. 

[0053]When there is change informationit is judged whether the simulator body 



motion control device 5 receives attitude information from the simulator motion 
information storing device 4for examplerotation of the simulator body 10 has 
change (Step S13Step S15or Step S17). When changefulthe simulator body motion 
control device 5 changes inclination of the simulator body 10 based on attitude 
information. When changeful also about translation motioncorrection of the 
position to order and a sliding direction is made. 

[0054]When rotation of the circumference of the X-axis has changespecificallythe 
revolving speed of the circumference of the X-axis in the simulator body 10 and a 
rotational size change with simulator body motion control devices 5 (Step S14). 
[0055]When rotation of the circumference of a Y-axis has changethe revolving 
speed of the circumference of the Y-axis of the simulator body 10 and a rotational 
size change with simulator body motion devices 5 (Step S16). 
[0056]When rotation of the circumference of the Z-axis has changethe revolving 
speed of the circumference of the Z-axis of the simulator body 10 and a rotational 
size change with simulator body motion control devices 5 (Step S18). 
[0057]After the state of the simulator body 10 changesit returns to Step S1 
further. In an attitude information output processa prohibited state has an input of 
the attitude information from the simulator motion information input device 6. 
[0058]By constituting in this wayit becomes possible using the users 16 image 
recognition capability to make move feeling (attitude information) memorize 
according to the image displayed on the screen 3 for video outputs. 
[0059]The image of 1 and the attitude information of corresponding 1 are chosen 
from the memorized attitude information of two or more memorized images and 
pluralityand it becomes possible to move the simulator body 10 based on this. 
[0060] 

[Effect of the Invention]As mentioned aboveaccording to this inventionattitude 
information can be extracted based on human beings image recognition capability. 
The extracted attitude information can be matched with video informationand can 
be memorized. Therebyit becomes possible using video information and human 
being's image recognition capability to operate a simulator. 
[006 1]Thereforeif there is even video informationthe virtual experience of the 
experience obtained when it rides on various vehicles can be carried out. 
[0062]Since specific attitude information can be selectively read out of the 
memorized attitude information (move feeling)it becomes possible to experience 
vicariously not only the sensed move feeling of self but the move feeling of the 
vehicle which other passengers received. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a figure showing the entire configuration of the attitude 
information input store-and-forward-of-switching-signal device 100 in the 
embodiment of the invention 1. 



[Drawing 2] It is a figure showing an example of the memory content of the 
simulator motion information storing device 4 shown in drawing 1 . 
[Drawing 3] It is a flow chart for explaining the contents of the attitude information 
input accumulative process in the attitude information input store-and-forward- 
of-switching-signal device 100. 

[Drawing 4] It is a flow chart for explaining the contents of the attitude information 
output process in the attitude information input store-and-forward-of-switching- 
signal device 100. 
[Description of Notations] 

1 Image storage device 

2 Image output unit 

3 The screen for video outputs 

4 Simulator motion information storing device 

5 Simulator body motion control device 

6 Simulator motion information input device 

7 Navigational panel 

8 Controller 

10 Simulator body 

14 The seat stand for passengers 

100 Attitude information input store-and-forward-of-switching-signal device 



